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Technique  for  Gridded  Data 


by 

David  L.  Cozart 

ABSTRACT 

An  interpolation  technique  is  implemented  which  is  applicable  to 
terrain  data  defined  on  a  rectangular  grid.  The  technique  also  allows 
for  data  compaction,  i.e.,  effectively  representing  the  given  data  using 
less  space  than  required  by  the  raw  data.  The  technique  involves  finding 
bicubic  polynomials  which  represent  the  terrain  surface  over  small 
subgrids.  These  surfaces  are  then  pieced  together  to  form  a  global 
surface  which  is  both  continuous  and  smooth  over  the  entire  region. 


I.  INTRODUCTION 

The  Air  Force  is  engaged  in  a  project  to  develop  techniques  for 
out-the-window  scene  generation  utilizing  the  digitized  terrain 
elevation  data  supplied  by  the  Defense  Mapping  Agency.  The  data  is  to 
be  used  to  generate  a  terrain  surface  appropriate  for  simulation  of  an 
out-the-window  view  of  actual  terrain  as  seen  from  a  low  flying  aircraft. 
The  terrain  data  is  defined  on  a  rectangular  grid  with  a  grid  point 
separation  of  three  seconds.  A  method  of  data  compaction  is  sought  which 
1)  will  allow  rapid  access  to  the  data,  2)  will  allow  immediate  display 
of  the  terrain  and  3)  will  represent  actual  terrain  as  accurately  as 
possible. 

A  technique  for  surface  generation  from  DMA  data  has  already  been 

considered  by  James  Jancaitis^  for  the  U.S.  Army  Engineer  Topographic 

Laboratories.  Jancaitis  replaces  the  original  data  with  local  least- 

square  polynomial  approximations  which  overlap.  These  local  approximations 

are  then  combined  using  weighting  functions  to  produce  a  smooth  polynomial 

approximation  to  the  initial  data.  The  polynomial  approximation  may  then 

5,6 

be  used  to  visually  display  the  surface.  Robert  Jablinske  has  applied 
this  method  to  actual  DMA  data,  and  the  results  have  been  compared  with 
results  obtained  by  using  conventional  matrix  storage  techniques.  The 
results  of  this  comparison  indicate  that  the  Jancaitis  method  introduces 
too  much  error  into  the  terrain  model  for  certain  types  of  terrain  and 
that  conventional  matrix  storage  techniques  work  just  as  well  in  terms  of 


compaction  and  error. 


II.  DESCRIPTION  OF  INTERPOLATION  TECHNIQUE 


An  alternative  method  of  data  compaction  and  interpolation  has  been 
implemented  and  tested  using  actual  DMA  terrain  data.  This  method  is 
described  below.  The  DMA  terrain  data  consists  of  integer  2  values  defined 
on  a  rectangular  grid  with  a  grid  spacing  of  3  seconds.  The  data  is 
organized  into  manuscripts  each  of  which  covers  a  one  degree  by  one  degree 
area.  Thus  the  data  is  organized  as  shown  below  in  Figure  1.  Each  "o" 
indicates  the  location  of  a  z-value. 


FIGURE  1  -  ORGANIZATION  OF  DMA  DATA 


The  DMA  data  in  Figure  1  has  been  organized  so  that  4x4  =  16 
terrain  heights  are  considered  as  a  unit  for  interpolation  purposes. 

The  number  of  data  points  on  a  vertical  or  horizontal  boundary  of  a 
square  subgrid  is  referred  to  as  the  NFF  value  for  that  subgrid.  In 
Figure  1,  the  NFF  value  for  each  subgrid  is  4.  Interpolation  is  performed 
for  NFF  values  of  5,6, 7,8  and  9. 

For  a  particular  NFF  value  and  a  particular  subgrid  of  size 
NFF  x  NFF  a  bicubic  polynomial  of  the  form 
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is  obtained  where  all  sixteen  a. .  coefficients  are  integers.  These  bicubic 

3-J 

surfaces,  one  for  each  subgrid  of  size  NFF  x  NFF  are  pieced  together  to  form 
a  continuous  and  smooth  global  surface.  For  the  derivation  of  this  bicubic 
polynomial,  the  gridded  data  in  each  subgrid  is  scaled  as  indicated  in 


Figure  2. 
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FIGURE  2  -  SCALING  OF  DATA 


The  bicubic  polynomial  of  Equation  1  is  obtained  by  using  the  values 
z,zx,2y,zxy  at  the  four  corner  points  of  the  subregion  in  Figure  2.  These 

sixteen  values  completely  determine  the  f(x,y)  of  Equation  1.  The  deri¬ 
vation  of  f(x,y)  proceeds  as  follows: 


H  *  XAY 


where 


with 


at  corner  point  (k,m), 
k  =  0,1  and  m  *  0,1 


Solving  Equation  2  for  A,  we  obtain 


A  -  X"1  H(Y_1)T 


(-7 


Thus  the  bicubic  f(x,y)  of  Equation  1  is  easily  determined  once  the 
values  z,  z^Zy  and  zXy  are  known  at  the  four  corner  points  of  the 
subregion . 

The  bicubic  polynomial  obtained  above  interpolates  the  four  corner 
points  of  the  subgrid.  Now  consider  an  adjacent  subgrid  and  the 

1 

corresponding  bicubic  surface  over  this  region.  It  is  easily  shown 
that  these  two  surfaces  over  the  common  boundary  line  meet  each  other 
in  a  continuous  manner  and  that  they  meet  in  a  smooth  manner  in  the 
sense  that  first  partial  derivatives  are  equal  on  the  boundary  line. 


Hence  a  global  surface  is  obtained  which  is  continuous  and  smooth  by 
piecing  together  the  bicubic  polynomials  defined  over  each  subgrid. 


In  order  to  implement  the  above  process,  the  following  values  must 
be  obtained: 

(1)  values  for  zx,Zy  and  zXy  at  the  corner  points  of  each  subgrid. 

(2)  a  value  for  NFF.  For  larger  NFF  values,  more  data  compaction 
occurs  since  the  NFF  x  NFF  z -values  of  each  subgrid  will  be 
represented  using  the  16  integer  coefficients  of  Equation  1. 
Also  as  the  NFF  value  gets  larger,  the  bicubic  polynomial  of 
Equation  1  will  not  represent  the  actual  z-values  as  well  as 
for  smaller  NFF  values.  Thus  the  NFF  value  should  be  chosen 
to  be  the  largest  value  for  which  the  corresponding  error  is 
acceptable. 


The  zx, Zy  and  z^  values  are  obtained  in  two  different  ways: 


(1)  Formula  method:  Both  three-point  and  five-point  formulas  are 


available  for  approximating  z  and  z  •  The  following  five-point 


x  y 

formulas  are  applied  to  the  DMA  data: 


z„(0,0)  -  ~  1  z(-2h,0)  -8z(-h,0)  +  8z(h,0)  -z(2h 
x  L2h 


zy(0,0) 


_L  r 
12h  L 


z(0,-2h)  -8z(0,-h)  +8z(0,h)  -z(0,2h)j 
The  h-value  in  the  above  formulas  represents  the  scaled  distance 


,0)j 
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between  grid  points  on  the  x-axis.  The  z  value  is  obtained 

xy 


using  the  following  formula  : 

z _ ( i » j  ) 


Zi+l,j-l  +  Zi-l,j-l  2i-l , j+1 


(10) 


(11) 


(2) 


Least  squares  method: 

g(x,y)  = 


A  bicubic  polynomial  of  the  form 
3  3 

Z  Zb.  .x'^y'' 

i-0  j=0  1J 


is  obtained  using  the  method  of  least  squares.  The  b^  values 

in  Equation  11  are  real  numbers.  The  bicubic  obtained  is  used 

to  determine  z  ,  z  and  z  .  To  apply  the  method  of  least  squares, 
x  y  xy 

the  data  on  each  subgrid  is  scaled  as  shown  in  Figure  3.  The  NFF 
value  of  5  is  fixed  for  this  stage. 


(-1. 


x,  y 


xy 


FIGURE  3  -  SCALING  OF  DATA 


The  method  of  least  squares  involves  finding  a  bicubic 

polynomial  as  in  Equation  11  which  is  defined  over  the  entire 

subgrid  and  which  best  approximates  the  given  terrain  data 

(z-values)  in  the  following  sense:  Let 

§2  E  (g(x,y)  -  z(x,y))2 

all  (x,y)  (12) 

in 

sub grid 

where  z(x,y)  is  the  actual  terrain  height  at  the  point  (x,y). 

The  g(x,y)  bicubic  polynomial  obtained  is  the  bicubic  which 
2 

minimizes  the  S  value  in  Equation  12. 


■vv>. 


The  above  minimization  requirement  leads  to  a  set  of  simultaneous 

normal  equations  which  must  be  solved  to  obtain  g(x,y).  This  system 

theoretically  has  a  solution,  but  the  solution  is  difficult  to  obtain 

accurately  because  of  round-off  error.  Also  considerable  computing 

time  is  required  in  solving  such  a  system  of  equations.  Hence  an 

alternative  method  is  used  to  improve  our  approximation  of  the  z- 

values  and  to  reduce  the  amount  of  CPU  time  needed  to  calculate 

g(x,y).  The  alternative  method  uses  orthogonal  polynomials  and  the 

4 

are  obtained  as  follows  : 

Polynomials  P.  i  =  0,1, 2, 3,  are  obtained  where  P.  is  a  polynomia 
i>  i 

of  a  single  variable  of  degree  i.  The  P.'s  all  have  a  leading 


coefficient  of  1.  Set 


Let 


P0(x) 


1  . 


S 

o 


NFF 

Z 

n=l 


[W] 
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(13) 


(14) 


and 


(15) 


Then 


P. (x)  *  (x  -  B  )-P  (x) 
1  0  0 


(16) 


With  P  ,P,  already  constructed,  P-  is  obtained  by  letting 


P  (x)  -  (x-B  )P  (x)  -  CL  -  P  (x)  . 

2  11  1  o 


The  polynomial  P^(x)  is  obtained  in  a  similar  manner. 


The  set  of  polynomials 

|Pi(x).P^(y)  |  i  =  0,1, 2, 3;  j  =  0,1, 2, 3} 

then  form  a  set  of  othogonal  polynomials  for  the  (x.y)-grid  of 

Figure  3.  A  bicubic  g(x,y)  of  the  form 

3  3 

g(x,y)  =  T  T  biiPi(x) •Pi (y) 

i=0  j=0 


is  obtained  by  letting 
5  5 


bij  = 


2  2,  '  W’W 

r=»l  s=l 


J  i.  v  l 

Z  P.(x  )  .  *  P  (y  ) 

r-1  1  r  r=l  2  r 


where 


x(r)  »  -1.0  +  (r  -  1.0)/2, 


y(r)  =»  -1.0  +  (r  -  1.0)/2 


Thus  the  z  z  and  z  are  obtained  in  two  ways:  (1)  Formula  method 
x,  y  xy 


and  (2)  Least  squares  method.  These  two  methods  are  compared  to  determine 
which  yields  a  better  approximation  to  the  terrain  heights. 


The  method  of  determining  the  optimal  NFF  value  to  use  for  a  particular 


manuscript  is  now  described.  As  mentioned  earlier,  a  large  NFF  value  is 
desired  for  compaction  purposes;  however  the  error  introduced  in  representing 
the  terrain  surface  increases  as  the  NFF  value  increases.  Thus  to  determine 
an  appropriate  NFF  value,  an  error  analysis  is  performed  on  each  manuscript 
for  NFF  values  of  5,6, 7,8  and  9.  For  each  of  these  NFF  values,  the 
following  error  terms  are  calculated  over  an  entire  manuscript: 


Error  (x,y)  =  z(x,y) 

2 

Relative  Error  =  - 


-  approximated  z(x,y) 

(x,y)  -  approximated  z(x,y) 
z(x,y) 


x  100 


(24) 

(25) 


Average  Error  =  j  Error (x,y) 

All  (x,y) 
in 

Manuscript 


number  of  terms 


(26) 


Average  absolute  Error  = 


All  (x,y) 
in 

manuscript 


j  Error(x,y)  |^/nu 


number  of  terms  (27) 


Standard  Deviation  of  Error  * 


A 


2  2 
ZError  (x,y)  _  (Ave.  Error) 


(28) 


//of  terms 


Also  a  histogram  of  error  terms  is  generated  for  each  NFF  VALUE.  Thus  for 

NFF  values  from  5  to  9,  an  error  analysis  table  is  generated  for  the 

manuscript.  Comparing  the  error  analysis  tables,  one  chooses  the  largest 

NFF  value  for  which  the  error  values  are  acceptable.  This  process 

associates  a  single  NFF  value  with  each  manuscript.  To  compare  the  two 

methods  of  obtaining  the  z  ,z  and  z  values,  error  analysis  tables 

x  y  xy 

are  generated  for  each  method. 


III.  INTERPOLATION  TECHNIQUE  APPLIED  TO  AcTUAL  DMA  DATA 


The  results  of  applying  the  above  techniques  to  actual  DMA  terrain 

data  are  described  below.  The  manuscript  used  for  this  analysis  has  a 

southwest  comer  point  which  resides  at  47°north,  124°  west.  The  two 

methods  (Formula  method  and  Least  Squares  method)  for  generating  the 

z  ,z  and  z  values  are  both  used.  The  data  values  which  fall  in  the 
x  y  xy 

shaded  region  of  Figure  4  are  not  approximated  by  the  bicubic  surface. 
These  values  however  are  used  in  approximating  derivative  values  for 
interior  points. 


(NFF-1) 


rows  of  data 


FIGURE  4  -  VALUES  NOT  APPROXIMATED  BY  BICUBIC  POLYNOMIAL 


The  error  analysis  tables  for  this  manuscript  are  found  in  the 
Appendix.  Table  1  gives  the  error  analysis  for  a  bicubic  surface  obtained 
by  the  method  of  Least  Squares  with  NFF  =  5.  This  surface  represents 
the  bicubic  surface  that  best  fits  the  data  in  the  sense  of  Equation  12. 
This  local  surface  however  does  not  yield  a  global  surface  which  is 
continuous.  Table  1  shows  that  this  surface  fits  the  terrain  data  with 
minimal  error.  Table  2  gives  the  error  analysis  for  NFF  =  5  where  the 
Formula  technique  is  used  to  generate  2x>Zy  and  zXy'  Table  3  contains  the 

same  error  analysis  except  that  the  Least  Squares  method  is  used  to  obtain 


As  shown  by  Tables  1-3,  more  error  is  introduced  into  the  bicubic  surface 
in  order  to  obtain  global  continuity  and  smoothness.  Also,  comparing  Tables 
2  and  3,  it  seems  as  though  the  Formula  method  of  generating  2x*zy  and  zxy 

yields  a  bicubic  surface  which  better  represents  the  actual  terrain  data 
than  does  the  more  complex  Least  Squares  method. 

Tables  2  and  3  show  that  the  global  bicubic  surface  fits  the  terrain 
data  reasonably  well  for  NFF=5 .  In  this  case  76.1%  of  the  error  terms  fall  in  the 
interval  (-10,10)  for  the  Formula  method  and  the  corresponding  value  for 
the  Least  Squares  method  is  60.7%.  Also  only  .2%  of  the  absolute  value  of 
the  error  terms  are  larger  than  100  using  the  Formula  method. 

Tables  4-6  present  a  similar  error  analysis  for  NFF  =  6.  Similar 
patterns  as  those  for  NFF  *  5  also  appear  here.  The  Formula  method  again 
gives  less  overall  error  than  does  the  Least  Squares  technique-  However  the 
maximum  absolute  error  using  the  Formula  method  (555.87)  is  significantly 
larger  than  the  corresponding  value  for  the  Least  Squares  method  (356.17)  . 

Tables  5  and  6  show  that  a  reasonably  good  functional  approximation  to  the 
terrain  data  is  obtained  for  NFF  =  6.  For  this  NFF  value,  the  percent 
of  terms  which  falls  in  the  interval  (-10,10)  is  65.0%  or  51.9%  depending 
upon  whether  the  Formula  method  or  the  Least  Squares  method  is  used. 

Tables  7-15  present  the  same  error  analysis  for  NFF  values  of  7-9. 

In  all  cases  the  Formula  method  gives  better  results  than  does  the  Least 
Squares  method  even  though  the  maximum  absolute  error  tends  to  be  larger 
for  the  Formula  technique.  The  contents  of  Tables  1-15  are  summarized  in 


Table  16. 


For  compaction  purposes  the  NFF  x  NFF  z-values  on  each  subgrid  are 
replaced  with  the  16  integer  coefficients  of  the  bicubic  polynomial  of 
Equation  1.  If 

_  ,  .  number  of  z-values 

Compaction  Ratio  =  number  of  coefficients  (29) 

then  for  NFF  =  6,  the  compaction  ratio  is  1.6  and  for  NFF  *  7,  this  value 
is  2.3.  Thus  for  NFF  =  6,  the  DMA  terrain  height  data  set  is  1.6  times 
as  large  as  the  data  set  consisting  of  coefficients  of  bicubic  polynomials. 
The  compaction  ratios  for  NFF  =  5-9  are  listed  in  Table  16. 

IV.  ADDITIONAL  RESEARCH  QUESTIONS 

(1)  For  the  Least  Squares  method  of  finding  z,zx  and  zxy  at  a  corner 
point  of  a  subgrid,  only  the  points  marked  by  "x"  below  in  Figure  5  are 
used  in  this  derivation. 

o  o  o  o  o  o 

I 

X  X  X  X  X  o 

x  x  x  x  x  o  ^0*  corner  point  where  derivatives 

|  fa  are  being  approximated. 

X  X  X - X - X - o 

X  X  X  X  X  o 

X  X  X  X  X  o 

FIGURE  5  -  POINTS  USED  IN  METHOD  OF  LEAST  SQUARES 

Should  the  number  of  points  vary  as  NFF  changes? 

(2)  What  effect  would  a  weighted  least  squares  technique  for 
finding  zx,Zy  and  z x^  have  on  the  error  analysis? 

(3)  Can  the  technique  be  extended  to  include  the  points  in  the 
shaded  region  of  Figure  4? 


(4)  A  data  set  consisting  of  all  z,z  ,z  and  z  values  at  corner 

x  y  xy 

points  of  subgrids  may  be  used  to  represent  the  terrain  surface.  With  this 

set  much  more  compaction  takes  place.  However  some  compaction  is  lost 

because  z  ,  z  and  z  are  real  values  instead  of  integers.  Can  this  problem 
x  y  xy 

be  overcome  to  increase  the  amount  of  compaction  obtained  without  increasing 
the  amount  of  error . 

(5)  Does  the  Formula  method  produce  better  results  than  the  Least 
Squares  method  over  a  wide  range  of  terrain  types? 

(6)  Can  the  maximum  absolute  error  using  the  Formula  method  be  reduced 

(7)  What  other  formulas  might  be  used  to  obtain  z^Zy  and  zxy ? 

Note:  All  programs  developed  for  this  grant  are  written  in  Pascal  and 
run  on  a  PDP-11/44  computer  system  which  uses  the  UNIX  operating 
systems. 
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TABLE  1 


ERROR  ANALYSIS  USING  LOCAL  BICUBIC 
OBTAINED  BY  METHOD  OF  LEAST  SQUARES 
GLOBAL  SURFACE  NOT  CONTINUOUS 

NFF  -  5 


AVERAGE  ERROR  =  -0.  00 

AVERAGE  ABSOLUTE  ERROR  =  1.  04 

MAXIMUM  ABSOLUTE  ERROR  *  99.  51 

STANDARD  DEVIATION  OF  ERROR  =  2. 19 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

= 

0 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

i 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

a 

0 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

a 

0 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

a 

8 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

a 

14 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

a 

22 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

138 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

650 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

7390 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

1228381 

* 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

990264 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

a 

7287 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

668 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

141 

* 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

a 

51 

* 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

a 

8 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

a 

0 

* 

OF 

ERROR 

VALUE5 

BETWEEN 

70 

AND 

80 

a 

1 

* 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

a 

0 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

a 

1 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

a 

0 

HISTOGRAM  DATA  FOR  1 

RELATIVE  ERRORS 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0  AND  5 

a 

2204606 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5  AND  10 

a 

2885 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10  AND  15 

a 

750 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15  AND  20 

a 

314 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20  AND  25 

a 

172 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  2! 

5 

a 

667 

TABLE  2 


ERROR  ANALYSIS  USING  FORMULA  METHOD 
NFF  =  5 


AVERAGE  ERROR  =  0. 00 

AVERAGE  ABSOLUTE  ERROR  *  S.  34 

MAXIMUM  ABSOLUTE  ERROR  *  298.  87 

STANDARD  DEVIATION  OF  ERROR  =  16.  54 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

2097 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

1229 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

1887 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

2837 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

3 

4354 

« 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

=* 

6913 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

11565 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

19915 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

37724 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

s 

82563 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

601500 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

=r 

461563 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

90907 

* 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

40499 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

S 

20854 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

sx 

11516 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

as 

6394 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

* 

3807 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

s 

2300 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

1359 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

773 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

as 

1165 

HISTOGRAM  DATA  FOR  RELATIVE  ERRORS 


« 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

= 

1288901 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

3 

70068 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

= 

20072 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

7908 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

* 

3737 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

7025 

TABLE  3 


ERROR  ANALYSIS  USING  LEAST  SQUARES 
WITH  ORTHOGONAL  POLYNOMIALS 

NFF  *  5 


AVERAGE  ERROR  *  0.  16 

AVERAGE  ABSOLUTE  ERROR  =  13.  27 

MAXIMUM  ABSOLUTE  ERROR  =  302. 39 

STANDARD  DEVIATION  OF  ERROR  *  22.  21 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

1619 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

1320 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

2509 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-BO 

AND 

-70 

SB 

4758 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

8650 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

S 

14800 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

a 

25458 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

a 

42002 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

a 

67609 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

a 

112539 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

491296 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

a 

350668 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

108196 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

66921 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

a 

42574 

* 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

a 

26301 

« 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

a 

15697 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

a 

9215 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

5263 

* 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

2834 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

1630 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

a 

2350 

HISTOGRAM  DATA  FOR  RELATIVE 

!  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

=  1197347 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

=  128576 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

=  33751 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

=  12528 

« 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

=  5753 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

*  10244 

TABLE  4 


ERROR  ANALYSIS  USING  LOCAL  BICUBIC 
OBTAINED  BY  METHOD  OF  LEAST  SQUARES 
GLOBAL  SURFACE  IS  NOT  CONTINUOUS 

NFF  =  6 


AVERAGE  ERROR  =  -0.  00 

AVERAGE  ABSOLUTE  ERROR  -  1.  66 

MAXIMUM  ABSOLUTE  ERROR  =  93.  76 

STANDARD  DEVIATION  OF  ERROR  =  3.  20 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


ft 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

= 

0 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

5 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

1 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-SO 

AND 

-70 

4 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

8 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

25 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

96 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

331 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

1698 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

18323 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

S 

1033608 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

981851 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

18146 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

a 

1761 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

a 

344 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

a 

95 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

35 

# 

OF 

ERROR 

VALUE5 

BETWEEN 

60 

AND 

70 

= 

10 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

a 

12 

* 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

s 

3 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

0 

* 

OF 

ERROR 

VALUES 

ABOVE  100 

= 

0 

HISTOGRAM  DATA  FOR  RELATIVE 

ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

S 

2023993 

» 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

a 

5864 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

a 

1267 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

s 

480 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

= 

246 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

1025 

TABLE  5 


ERROR  ANALYSIS  USING  FORMULA  METHOD 
NFF  =  6 


AVERAGE  ERROR  =  0. 00 

AVERAGE  ABSOLUTE  ERROR  =  14. 63 

MAXIMUM  ABSOLUTE  ERROR  =  555.  87 

STANDARD  DEVIATION  OF  ERROR  =  28. 94 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

13864 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

4124 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

5495 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

7373 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

10068 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

35 

14130 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

s 

20503 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

30779 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

48359 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

88290 

« 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

509062 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

395108 

* 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

=* 

98633 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

s 

53499 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

* 

33348 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

35 

21739 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

— 

14767 

* 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

s 

10423 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

SO 

=5 

7301 

» 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

5269 

* 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

s 

3734 

# 

OF 

ERROR 

VALUES 

ABOVE 

LOO 

10728 

HISTOGRAM  DATA  FOR  RELATIVE  ERRORS 


# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

55 

1173694 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

= 

120716 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

= 

44632 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

20263 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

= 

10946 

* 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

20575 

PJ  O' 


TABLE  6 


ERROR  ANALYSIS  USING  LEAST  SQUARES 
WITH  ORTHOGONAL  POLYNOMIALS 


NFF  =  6 

AVERAGE  ERROR  =  0.  34 

AVERAGE  ABSOLUTE  ERROR  =  30. 38 

MAXIMUM  ABSOLUTE  ERROR  =  356. 17 

STANDARD  DEVIATION  OF  ERROR  =  33. 54 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

12154 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

6554 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

9619 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-SO 

AND 

-70 

= 

13670 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

19197 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

26212 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

35894 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

S 

48707 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

a 

66736 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

99444 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

409952 

* 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

302879 

* 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

94794 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

64926 

* 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

a 

48636 

* 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

a 

36416 

* 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

27179 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

19905 

* 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

a 

14525 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

10119 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

6942 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

a 

14396 

HISTOGRAM  DATA  FOR  RELATIVE 

:  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

=  1051168 

» 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

=  194723 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

=  67117 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

=  26833 

« 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

=  12397 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

=  21484 

TABLE  7 


ERROR  ANALYSIS  USING  LOCAL  BICUBIC 
OBTAINED  BY  METHOD  OF  LEAST  SQUARES 
GLOBAL  SURFACE  NOT  CONTINUOUS 

NFF  =  7 


AVERAGE  ERROR  =  -0.  00 

AVERAGE  ABSOLUTE  ERROR  =  2.  23 

MAXIMUM  ABSOLUTE  ERROR  =  104.  71 

STANDARD  DEVIATION  OF  ERROR  =  4.  12 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

= 

1 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

2 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

7 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-SO 

AND 

-70 

= 

7 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

27 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

58 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

200 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

718 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

3498 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

31 181 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

949126 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

920072 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

ss 

30740 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

3701 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

778 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

SB 

215 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

73 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

29 

* 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

SO 

= 

1 1 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

4 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

0 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

s 

1 

HISTOGRAM  DATA  FOR  RELATIVE 

ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0  AND 

5 

=  1905147 

» 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5  AND 

10 

=  9003 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10  AND 

15 

=  2020 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15  AND 

20 

=  648 

» 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20  AND 

25 

=  366 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

=  1223 

TABLE  B 


ERROR  ANALYSIS  USING  FORMULA  METHOD 
NFF  =  7 


AVERAGE  ERROR  =  -0.  15 

AVERAGE  ABSOLUTE  ERROR  =  22. 38 

MAXIMUM  ABSOLUTE  ERROR  =  968. 37 

STANDARD  DEVIATION  OF  ERROR  =  43. 94 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

= 

35484 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

7509 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

9251 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

1 1674 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

14560 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

19290 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

25497 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

35673 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

51749 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

85903 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

440994 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

343866 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

96796 

* 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

58142 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

39655 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

= 

28134 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

20683 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

15500 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

11923 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

9335 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

7438 

* 

OF 

ERROR 

VALUES 

ABOVE  100 

= 

30433 

HISTOGRAM  DATA  FOR  RELATIVE 

:  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

=  1055030 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

=  1 58582 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

=  69310 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

=  35812 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

=  20613 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

=  44622 

TABLE  9 


ERROR  ANALYSIS  USING  LEAST  SQUARES 
WITH  ORTHOGONAL  POLYNOMIALS 

NFF  =  7 


AVERAGE  ERROR  =  0. 48 

AVERAGE  ABSOLUTE  ERROR  =  27. 76 

MAXIMUM  ABSOLUTE  ERROR  =  462.  65 

STANDARD  DEVIATION  OF  ERROR  =  45.  07 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

36582 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

12580 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

15954 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

S 

20119 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

24657 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

30527 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

2 

37452 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

48589 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

61941 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

88691 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

367953 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

273742 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

s 

86212 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

61159 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

48406 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

= 

39029 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

31000 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

25060 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

20377 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

16643 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

13168 

# 

OF 

ERROR 

VALUES 

ABOVE 

100 

2 

39648 

HISTOGRAM  DATA  FOR  RELATIVE  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

938772 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

= 

238454 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

= 

100794 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

46287 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

= 

22596 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

as 

37066 

TABLE  10 


ERROR  ANALYSIS  USING  LOCAL  BICUBIC 
OBTAINED  BY  METHOD  OF  LEAST  SQUARES 
GLOBAL  SURFACE  NOT  CONTINUOUS 

NFF  =  8 


AVERAGE  ERROR  =  -0.  00 

AVERAGE  ABSOLUTE  ERROR  =  2.  84 

MAXIMUM  ABSOLUTE  ERROR  =  111.35 

STANDARD  DEVIATION  OF  ERROR  =  5.  06 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

= 

3 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

4 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

8 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

S 

18 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

48 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

a 

115 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

S5 

358 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

=5 

1227 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

6364 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

47003 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

a 

887467 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

3 

852907 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

45655 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

6426 

* 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

1412 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

= 

381 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

115 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

a 

54 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

22 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

6 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

a 

4 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

a 

3 

HISTOGRAM  DATA  FOR  RELATIVE 

ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

a 

1809789 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

a 

13813 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

a 

2845 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

898 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

a 

395 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

a 

1397 

TABLE  11 


ERROR  ANALYSIS  USING  FORMULA  METTHOD 
NFF  =  S 


AVERAGE  ERROR 
AVERAGE  ABSOLUTE  ERROR 
MAXIMUM  ABSOLUTE  ERROR 
STANDARD  DEVIATION  OF  ERROR 


-0.  09 
31.  85 
1403.  64 
62.  05 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

62649 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

s 

9877 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

11791 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

14278 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

17522 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

s 

21974 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

27998 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

37081 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

50928 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

79672 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

387648 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

as 

302871 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

s 

90140 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

s 

57793 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

at 

41552 

* 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

as 

31494 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

24061 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

as 

18963 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

as 

15650 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

12429 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

10452 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

s 

58506 

HISTOGRAM  DATA  FOR  RELATIVE 

:  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

9 

940332 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

35 

182346 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

= 

88962 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

50177 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

= 

30783 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

77848 

TABLE  12 


ERROR  ANALYSIS  USING  LEAST  SQUARES 
WITH  ORTHOGONAL  POLYNOMIALS 

NFF  =  8 


AVERAGE  ERROR  =  0.  86 

AVERAGE  ABSOLUTE  ERROR  =  35. 40 

MAXIMUM  ABSOLUTE  ERROR  ■  519.  23 

STANDARD  DEVIATION  OF  ERROR  =  57.  14 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

65695 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

15302 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

18116 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

ss 

21057 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

24713 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

= 

30281 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

s 

37606 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

ss 

44844 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

55881 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

77872 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

326163 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

244741 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

77213 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

55300 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

= 

43946 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

= 

37083 

* 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

30604 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

25952 

* 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

22067 

* 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

= 

19064 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

16323 

# 

OF 

ERROR 

VALUES 

ABOVE  100 

s 

70887 

HISTOGRAM  DATA  FOR  RELATIVE 

ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

SS 

816639 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

= 

249770 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

s 

123759 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

= 

63158 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

= 

34435 

* 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

s 

58847 

TABLE  13 


ERROR  ANALYSIS  USING  LOCAL  BICUBIC 
OBTAINED  BY  METHOD  OF  LEAST  SQUARES 
GLOBAL  SURFACE  NOT  CONTINUOUS 

NFF  =  9 


AVERAGE  ERROR  =  -0.  00 

AVERAGE  ABSOLUTE  ERROR  *  3. 44 

MAXIMUM  ABSOLUTE  ERROR  *  137.  58 

STANDARD  DEVIATION  OF  ERROR  -  5.  98 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN 

-100 

6 

# 

OF 

ERROR 

VALUES 

BETWEEN  - 

100 

AND 

-90 

= 

7 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

s 

7 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

38 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

s 

71 

* 

OF 

ERROR 

VALUES 

BETWEEN 

—60 

AND 

-50 

s 

171 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

633 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

s 

1997 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

3 

9933 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

3 

64715 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

3 

821266 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

= 

823352 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

62653 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

3 

10251 

* 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

3 

2174 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

3 

631 

« 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

= 

232 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

3 

81 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

S 

34 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

3 

17 

* 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

10 

* 

OF 

ERROR 

VALUES 

ABOVE  100 

3 

2 

HISTOGRAM  DATA 

FOR  RELATIVE  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

3 

1751709 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

3 

18797 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

3 

3952 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

3 

1222 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

3 

624 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

3 

1720 

TABLE  14 


ERROR  ANALYSIS  USING  FORMULA  METHOD 
NFF  =  9 


AVERAGE  ERROR 
AVERAGE  ABSOLUTE  ERROR 
MAXIMUM  ABSOLUTE  ERROR 
STANDARD  DEVIATION  OF  ERROR 


0.  46 
42.  08 
1812.  03 
81.  55 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

89005 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

11724 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-80 

= 

13821 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-80 

AND 

-70 

= 

16068 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

a 

19022 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

a 

23117 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

29408 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

a 

37385 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

49849 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

a 

74327 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

348065 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

a 

274773 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

a 

85557 

# 

OF 

ERROR 

VALUES 

between 

20 

AND 

30 

= 

56690 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

a 

42299 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

a 

32836 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

a 

25747 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

a 

21113 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

17329 

# 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

=s 

15065 

* 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

a 

12739 

# 

OF 

ERROR 

VALUES 

ABOVE  1 

LOO 

a 

89390 

HISTOGRAM  DATA  FOR  RELATIVE  ERRORS 


# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

s 

849803 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

as 

195173 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

s 

104007 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

a 

63196 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

a 

40232 

# 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

117912 

TABLE  15 


ERROR  ANALYSIS  USING  LEAST  SQUARES 
WITH  ORTHOGONAL  POLYNOMIALS 

NFF  *  9 


AVERAGE  ERROR 
AVERAGE  ABSOLUTE  ERROR 
MAXIMUM  ABSOLUTE  ERROR 
STANDARD  DEVIATION  OF  ERROR 


45.  95 
255.  SO 
2010.  73 
382.  27 


HISTOGRAM  DATA  FOR  ACTUAL  ERRORS 


# 

OF 

ERROR 

VALUES 

LESS  THAN  -100 

= 

328404 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-100 

AND 

-90 

= 

11246 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-90 

AND 

-SO 

= 

1 1661 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-SO 

AND 

-70 

= 

14320 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-70 

AND 

-60 

= 

31482 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-60 

AND 

-50 

S 

30084 

* 

OF 

ERROR 

VALUES 

BETWEEN 

-50 

AND 

-40 

= 

24537 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-40 

AND 

-30 

= 

23997 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-30 

AND 

-20 

= 

29065 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-20 

AND 

-10 

= 

33016 

# 

OF 

ERROR 

VALUES 

BETWEEN 

-10 

AND 

0 

= 

92908 

# 

OF 

ERROR 

VALUES 

BETWEEN 

0 

AND 

10 

ss 

63762 

# 

OF 

ERROR 

VALUES 

BETWEEN 

10 

AND 

20 

= 

32829 

# 

OF 

ERROR 

VALUES 

BETWEEN 

20 

AND 

30 

= 

28908 

# 

OF 

ERROR 

VALUES 

BETWEEN 

30 

AND 

40 

SS 

28027 

# 

OF 

ERROR 

VALUES 

BETWEEN 

40 

AND 

50 

s 

27967 

# 

OF 

ERROR 

VALUES 

BETWEEN 

50 

AND 

60 

s 

40328 

# 

OF 

ERROR 

VALUES 

BETWEEN 

60 

AND 

70 

= 

38665 

# 

OF 

ERROR 

VALUES 

BETWEEN 

70 

AND 

80 

= 

14587 

* 

OF 

ERROR 

VALUES 

BETWEEN 

80 

AND 

90 

ss 

12781 

# 

OF 

ERROR 

VALUES 

BETWEEN 

90 

AND 

100 

= 

12233 

# 

OF 

ERROR 

VALUES 

ABOVE  1 00 

454522 

HISTOGRAM  DATA  FOR  RELATIVE 

!  ERRORS 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

0 

AND 

5 

s 

180116 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

5 

AND 

10 

= 

93845 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

10 

AND 

15 

= 

87635 

* 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

15 

AND 

20 

s 

83596 

# 

OF 

REL. 

ERROR 

VALUES 

BETWEEN 

20 

AND 

25 

— 

81203 

* 

OF 

REL. 

ERROR 

VALUES 

ABOVE  25 

= 

843928 

TABLE  16 


technique  used  to 
obtain  2  ,2  and  z 


%  of  terms  where 
absolute  value  of 
error  is  <  10 


%  of  terms  where 
absolute  value  of 
error  is  > 100 


Compaction 

ratio 


i 

Formula 

76.1% 

.2% 

1.002 

;  5 

Least  Squares 

60.7% 

.3% 

1.002 

Formula 
Least  Squares 


Formula 
Least  Squares 


Formula 
Least  Squares 


65.0% 

51.9% 


56.7  % 
46.4% 


50.4% 

42.4% 


5.5% 

1.4% 


1.8% 

1.9% 


4.8% 

5.5% 


8.8% 

10.1% 
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